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INTRODUCTION 

Early in 1973, the Salt Lake City Public Library began to study the 
possibilities of launching a program designed to help the people of the 
community who wanted to educate themselves independently and without the 
aid of formal educational institutions. The first step was to sample the 
community members in order to determine if there was a need for a program 
of this type. The assumption that there was a need was proven correct, and 
so the staff at the Library began to examine methods of establishing an 
independent study program. It was found out that the College Entrance 
Examination Board was helping libraries to study the possibilities of such 
a program. So, with the determination of the Library's staff and with the 
support of CEEB, an experimental program for independent study and guidance 
was. started in Salt Lake City, using training in several subjects (among 
them, program planning and evaluation) provided by CEEB. This is a report 
on the use of program measurement and evaluation and the utilization of 
data gathered during the planning and implementation stage of the adult 
independent study and guidance program in Salt Lake City* 

PURPOSE 

The purpose of this report is (1) to explain what materials (data) 
are needed as a basis for discussion and inference for the implementation 
of a program; (2) to show how this material is analyzed for program measure- 
ment and evaluation; (3) to demonstrate how mechanisms for measurement 
and evaluation work for program planning and decision-making; and (4) 
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to relate the utilization of evaluative data to program planning and imple- 
mentation within existing library operations^. 

I ■ 

MATERIALS (DATA) FOR DISCUSSION AND INFERENCE 

To begin with, it must be clear that data is not necessarily a number 
or a statistic. Data are mearly materials that serve as a basis for discussion 
and inference. Some data are statistical by nature, and allow for elaborate 
inference. But other data are not. Descriptive documents are, in fact, 
data; and they may serve as the material needed, conceptually, for the 
initial step toward measurement and evaluation. Institutional goals and 
objectives are documents that can serve as initial data. 

Before program measurement can begin, other such documents must exist* 
Goals of the program, objectives of the program, alternative courses of 
action for the program, and definitions for the program must be written, 
and these statements iiiust conform to the values of the institution. These 
statements constitute the yardstick of measurement. Other collected data 
are the increments that measure on a scale the extent of the successes or 
failures of a program in relationship to goals and objectives. 

Typically, public libraries have goals and objectives that include 
statements about education. SLCPL's goal statement reads, in part, that 
. . the system will serve as a primary source of educational materials 
and services for individuals involved in informal self education or continuing 
education and as a secondary source for students engaged in formal education." 
The values of the institution are clearly in support of an independent study 
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project and allow for planning a service* The objectives supporting this 
goal are for services planned around recognized needs. The need for an 
independent study service was delineated, and the project planning began. 
The program began with its ovyn goal and objectives that allowed for 
evaluation. The program goal statement explains what the library intends 
to accomplish with the program. It states that • • the Library will 
become the Center for Independent Learning for Salt Lake City/* The objectives, 
of which there are four, support the goal and provide for actions and al- 
ternative strategies. The objective statements are specific descriptions of 
what has to happen in order to accomplish the program goal. An example is: 

OBJECTIVE L The Salt Lake City Public Library will provide 
assistance for the adult independent learner 
for planning and carrying out his/her learning 
goals. 

Following each objective are strategy statements that cause goal fulfillment* 

Another element of evaluation and measurement is the user definition. 
This definition is usually a statement abstracting who the service is for. 
This is an initial target statement and allows for specific user data. As 
an example, the SLCPL defined an "adult independent learner as (1) an 
individual whose library related project is not designed and/or controlled 
by formal educational institutions, (2) an individual with at least a 
grammar school education but not affiliated with a high school (as a student), 
who has assumed an adult role in society (such as self*-support) , and (3) an 
individual whose learning project consists of at least three meetings between 
himself and a staff learner consultant, and a minimum of seven hours of 
learning activity*" Note that all of these elements within the definition 
can be assessed and measured. 



The utilization of data for decision-making usually involves the selection 
of alternative courses of action that help meet program objectives. Action 
statenents generally outline tasks and performance measures that delineate 
alternative methods that can be taken. Such action statements follow and 
support objectives by outlining tasks. An example of an action or strategy 
statement is that "The Salt Lake City Public Library will develop a staff 
of learning consultants by October, 1974, with expertise in the field of adult 
independent learning, who will provide assistance to the learner through 
interviewing, guidance, educational planning, materials selection, referral 
services, and evaluation." Again, all of the action elements can be assessed 
and measured by some means and traced for effectiveness and effeciency. 

After actions and their alternatives are written, decisions relating to 
their selection generate the initial operations flow. If the operations can 
be put into some kind of model, it is usually easier for program planners 
to identify problem areas after early measurement. Changes in the operations 
flow after pilot implementation of the SLCPL's independent study project 
were made at sever:al places due to early assessment of service problems. 
The first and last page of the SLCPL*s operation flow are included in this 
report as Exhibit A. It is an example of an operations model. 

A statement regarding projections of achievement and success is needed 
in order to measure the program. This statement is a program target. 
Targets, in the beginning, are generally arbitrary, but ought to predict 
feasible outcomes for success. During the pilot phase of the Salt Lake 
project:, such targets were set up based on library constraints, community 
population, user satisfaction, and time. These targets were determined 



by the program planners, and were considered neither optomistic nor pessimistic. 
It was determined that the targets for this program would be: 

!• That .2% (two-tenths of one per-cent) of the 

population of Salt Lake City v/ill inquire 
about the program during the four-month 
pilot phase. 

P X n « T where P is the population and n is a number 

of those people; T is the target number that 
will inquire about the program. 

176,000 (?) X .002 (n) = 352 (T) 

Z. That 5% (five per-cent) of those inquirers 

(T) will become Adult Self-Directed 
Learners, going on to complete a learning 
project. 

T X N « t where T is the target group for inquiring 
and N is a number of those people; t is 
the secondary target group, or learners 
who will complete a project. 

352 (T) X .05 (N) = 17.6 (t) or 18 
Adult Self-Directed Learners. 

3. That of these 18 learners, 85% (eighty- 

five per-cent) or 15 (fifteen) users 
will be satisfied with their project and 
the program. 

These targets can be measured and the data used to determine successes and 
failures. If targets, set up knowing library and community constraints, 
are not met, the program should be in question. If rjiet, perhaps improvements 
or expansion can be made. If targets are exceeded, as was the case in 
Salt Lake, other changes would need to be made. As examples, program planners 
had to change the operations flow, they had to make adjustments for the 
use of personnel, and they had to change certain acquisitions policies in 
order to accomodate more learners and their needs. Early measurement of 
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the pilot phase of the project indicated to program planners that the project 
would be more than double that of the targets estimated. Planners had to 
train more consultants, allow more time for work on the project, and change 
the operations flow to allow for other personnel to make initial contacts 
with learners. These are but a few examples of how targets, presented 
clearly to planners, can be measured for decision-maktng. 

These statements (goal, objectives, actions and strategy alternatives, 
definitions, and targets) are the initial tools of measurement. The statements 
outline for the evaluator what the service is, what it will accomplish, how 
it \/ill be accomplished, who will do it, who will use it, and how many 
should use it. From these statements come the basis for measuring outcomes, 
for testing results, for making decisions about the program, and for altering 
courses of action. With these program statements, an evaluator has some 
vital parts of an evaluation cycle, and some basic data to be utilized in 
program planning. This "cycle" is perhaps best graphically described, and 
it summarizes the process. 



Goals 

Objectives : 

Strategies 1 

Operations 



? 



Targets 



Definitions 



? 
. 

? 
? 
? 




Evaluation 
Program Planning 
Decision-making 
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MECHANISMS FOR MEASUREMENT 

To complete the evaluation/planning/decision-maklng cyc],e, the program 
must be measured with data collected ^bout users, services, and functions. 
Measurement Is nothing more, really, than monitoring the service to see that 
It meets the program goal and objectives* The monitoring system Is a mechanism 
for measuring the program and evaluating It through the analysis of data 
collected by performers for program planners and/or decision-makers* 

Monitoring the program requires the systematic collection of data. 
Data, in this case, are the answers to the questions emanating from the goal, 
objectives, actions, or targets. These questions must be formulated clearly 
and asked precisely so that the data gathered can present the variables and 
values of the program, which, in turn, answer the questions. 

Usually the questions for monitoring a program are asked through the 
use of forms. The independent study program at Salt Lake made clear the 
"living" quality of forms. They were devised, revised, changed and modified 
as evaluators saw that data was or was not answering questions needed for 
on-going program planning. The forms were designed to gather information 
on all factors of the program; all variables and values: the use of services, 
the users, the time spent, the operations, the resources used, the purchases 
made, the referrals made, the satisfaction of users and consultants, the 
facilities, and the costs. Examples of an interview form (for use, users, 
and program profiles), of a' progress report form, of a use and resources 
measurement form, of a time and estimated cost form, of a user evaluation form, 
and of a consultant's evaluation form are included in this report as Exhibit 
B, These forms are the mechanisms for data collection. They are recorded 



by on-line librarians, and it is important to explain that the use of the 
forms is not only valuable to administrators or program planners, but on 
the working level as well. Recordkeeping is important, and the value of 
the information must be stressed. It must also be made very clear that the 
utilization of data is for program and not personal or personnel evaluation. 
If this is understood, recordkeeping is usually performed with much more 
accuracy and efficiency. It should also be pointed out that so much program 
data need only be collected during the initial stages of the program, and that 
after so much time, the data could be collected using sampling techniques. 
This alleviates some strain on the on-line librarians who are the primary 
source of information about any program. 

After collection, the data must be coded, compared, analyzed, interpreted 
and reported. Coding is simply the charting of variables and values and begins 
to point out statistical measures, summaries, and comparisons. After data 
are coded, they can be compared to other data and to each other in order to 
glean information for program planning and to test assumptions. 

The utilization of this collected data relates directly to program 
planning. For instance, if in the definition it is stated that the program 
is not for students enrolled in formal education, but vhe data show. that 
33% of those enrolled in the program are students, then appropriate program 
adjustments must be made by planners. A more subtle example would be if 
program definitions allowed users of the program to be those financially 
strapped and therefore uninterested in formal education, yet the data pointed 
out that most people registered for the program were professionals with 
large incomes, then, again, appropriate planning action would be advisablB* 
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to modify some part of the program; perhaps publicity. For example, if the 
data pointed out that the publicity variable that introduced most people to 
the program was television, then posters in the generally poor sections of 
t\e community might bring the service more closely in line with program 
definitions. That strategy, too, could be tried and measured. 

Examples of the coding charts for the interview form, the progress 
report, and the personnel time per program function (costs) are included 
as Exhibit C. These coding sheets show program planners the profile of the 
program so that they can make decisions such c\s the above examples, and more. 
Without this and other reported data, planners would be probing in the dark 
with zero knowledge about the service, costs, and performance. 

There is, however, more to measurement and evaluation than examining 
coded data. That examination is only part of the operation. Analyzing and 
interpreting collected data is also important! Analyzation and interpretation 
is usually no more nor less than a description of the program in both statistical 
and summary terms, done in order to test further any formal assumptions and 
to predict future outcomes, either before or after any modifications. 

For the purposes of the independent study program at SLCPL, data were 
analyzed and interpreted in order (1) to describe the independent learner, 
(2) to describe the service provided by the program, and (3) to describe 
personnel time. Also, summary data were assembled to give program j)lanners 
an idea of totals and percentages, means, ranges, and medians in each of « 
the three catagories. These summaries provided feedback at the working level 
and input for program planners to adjust and modify services and to make 
staff projections for future levels of service. An example of the Library's 
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sumnary table for the four-month pilot phase is included as Exhibit D, 
User and consultant satisfaction was also sunmarized on a similar basis both 
for on-line librarians and propr-m planners* Totals, percentages, means, 
medians, and ranges were reported, when appropriate, for each variable* In 
turn, these were studied, and the program improved upon whenever indications 
of need were clear, both on individual project levels, and for the total 
prog ram • 

Summaries were used in order to learn what to expect (as an average) 
from a learner after identification: how much time would be needed, and how 
many resources or referrals had to be offered to satisfy learners. Because 
of this report, some adjustments in desk scheduling, learner flow, and clerical 
staffing were made for the entire Library System by program planner-s..^ the 
project. In addition, in order to accomodate the number of learners, which ^ 
totally exceeded the targets, more tasks analysis were made and training for 
consultants was set up and conducted by the program planning team. 

It also occured to the program planning team that this program, with its 
measurement mechanisms and techniques, would be ideal as a pilot for computerized 
research. If the computer research and analysis worked for this type of program, 
other program data could systematically be entered into the computer for 
analyzation, reporting, and significance testing in the future. Therefore, 
a computer program was designed to analyze the data already gathered, and to 
compute and analyze future data. The computer program did essentially the 
same thing as the evaluators before it, but quicker, easier, and with the 
additions of format reporting, regression analysis, and significance tests of 
variable relationships, correlations, etc. As well, the program computed 
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learner and other independent study data and compared it with data on 
traditional library users and the community census reports, both previously 

recordjsd. A summary of this report is included as Exhibit E. """v., 

The computer, able to give more detailed summary analysis of the three 
ii.dependent study program descriptors, not only reported on the distribution 
of learners by demographic characteristics, combinations of demographic 
characteristics, but also how learners were distributed with regard to 
learning goals and content area of interests, and how demographic characteristics 
related to project characteristics. These latter two measures were impossible 
without computer processing. Information resulting from these reports aided 
program planners greatly in that the informat-* n on content areas of interest, 
preferred learning methods, and locations, number of contacts to complete a 
project, and time intervals made it possible for the planners to better 
decide on allocations of space, facilities, collection building, and staff 
time allotments. 

The computer process also analyzed and described services provided by 
the program by yielding two summaries. The first summary showed the demand 
level for independent study services distributed over the time period of 
each learning project. The second summary printed out each learner's and 
each consultant's evaluation of the program and compared them. The first 
summary was important at the working level because it showed the time, process, 
and steps taken with learners as projects progressed. And, the first summary 
was important for program planners because it detailed learner's demands for 
various services and the frequency of each demand and service used. In this 
case, planners could opt to cut some services while embellishing others. 



01^ 



ERiC 



13 



The learner's and consultant's evaluation summaries pointed out strengths 
and weaknesses with the program, and provided direct feedback wl.ich could 
lead to program modifications if significant. Again, these data are useful 
for program planners for making decisions about what services should be cut, 
which modified, and which continued for best programming. 

A third computerized report showed the distribution of time spent with 
learners and summarized time spent supporting learners. Program planners 
could use this report to determine cost effectiveness of the services. As 
yet. Salt Lake has not done the cost effectiveness study. The report was, 
however, used to determine relative costs and to project staffing requirements. 

Another computer process analyzed each value of each variable and 
predicted which would be constant, which would fall or drop out, and which 
would excel 1. This report gave planners an idea of what to expect in the 
future from one month away to as much as a year away. 



USE OF DATA , * 

All of the various program monitoring mechanisms, whether as simple as 
a coded summary or as complex as computer processing, can be used by planners 
in several ways. To begin with, collected, coded, and analyzed data can be 
used for first level evaluation (a quick sense of what is happening for some 
minor repairs), and second level evaluation (a more complex study of strategies 
for cost effectiveness, major operations changes, staffing requirements, 
or cutting or embellishing services). 

Collected, coded, and analyzed data can be used for formative and 



summative conclusions by planners. Formative conclusions are generally 
used at the working level and give both learners and their consultants 
information to better reach program goals. Planners can use formative or 
process conclusions for staffing requirement information, for authority 
delegation, and for decisions about supportive services, and for simple 
operations changes. Summative data or product conclusions allow for planners 
to see if targets are met, if definitions are followed, if actions were 
properly selected and executed, and, in short, if objectives were met or 
the goal accomplished. At given time intervals, summative data answers the 
question: Did we or did we not do what we set out to do? 

Fastidiously examined descriptive reports should allow planners to 
display program effeciency to policy makers for support, and to show program 
effectiveness to users and management alike, as well as to adjust program 
factors for better service strategies. If reviewed properly, data summaries 
can also be utilized by plajiners in order to select .alternative courses of 
action in order to modify operations, and in order to change whole systems 
for better library service to a community. 

DATA AND PROGRAM PLANNING 

« 

It is my hope that this repor^ will not lead librarians to believe that 
they must be researchers in order to have the necessary knowledges and skills 
to perform program planning and evaluation. Certainly there are some skills 
and knowledges needed by planners if evaluative data is to be used effectively 
for d2cision-making» A program planning and evaluation team should be able to 
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select, collect, analyze and interpret data dealing with programs. But they 
must also know and understand the real world and the restraints and constraints 
of the system and the community environment. They do not need to 1)6^, part 
of d research ivory tower. Instead, it is better to have some research skills 
and a full knowledge of the real world to which libraries belong. As in 
Salt Lake City's case, a program planning and evaluation team should be 
able to diagnose difficulties, collect information to help induce change, 
and, after changes have been made, evaluate the effectiveness of the change. 
The research aspect should be clearly subordinate to bringing about needed 
modifications in program structure and function. Research evaluation is a 
means of describing a program. The utilization of that description belongs 
mostly to planners and decision-makers. 

\ 

SUMMARY 

Program planners need to be aware of organizational resistance and of 
institutional committments to values. Planners should not use data for 
strong idealogical actions, but as a means to improve the way programs meet 

i 

objectives. In short, program planners should consider collected, analyzed, 

* 

and reported data as indicators of effeciency and effectiveness. With these 
indicators as evidence, program planners can propose* modifications, select 
alternative courses of action, relate the effectiveness of different strategies 
to meet goals and objectives, test assumptions, and advocate change. In 
summary, this is the relationship between program planning and the utilization 
of data for program implementation within existing library operations. The 
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"cycle" is complete when goals, objectives, and strategies are measured and 
analyzed in order to make decisions, select new actions, re-define targets 
and strategies, and again measure for effectiveness and effeciency— round 
and round and back. To me^ this cycle is the relationship between the utili- 
zation of data and program planning and evaluation* 
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The purpose of this form is to provide the advisor with information about the 
learner and to provide both the advisor and the learner with a common basis for 
working through the learning project. This form should be filled out by the ad- 
visor. 



Interview conducted: 



J^hone 
"in Person 



INTERVIEW 
Date 



LD. NO, 



Time: Begun 



End 



General Information About Learner 



1. Learner^ 
3. Address 



Street 

4* Home Phone 

5, Resident 



Business Phone 



City State 
Best time to call 



Non-Resident 



.In Service Area 



6. Specific Occupation^ 



/ 

7. Occupational Category: (Coder will complete) 



^Housewife 

Jlue Collar Worker 

"Professional 



Manager, Administrator 

pother White Collar Worker 

Unemployed 



_Re tired 
"student 



8* Age: (Circle one) -18 
9, Use of Project Library: 



18-24 25-34 35-44 45-54 55-64 65+ NR 



Once or more a month 

Once or more every 6 months 

Once or more a year 

10. Use of Other Libraries: 

Once or more a month 

Once or more every 6 months 

^Once or more every^year. 



_Less than once a year 
"Never 



^Less tharr once a year 

Never 



11, Library Card: Yes No NA 

12* Learned of Learners Advisory Service through: 

TV ^Radio Newspaper Library Display ^Community Display 

^Librarian WorT"of Mouthy "Another Agency .Community Outreach 



13, Education Completed: 

^8th grade or less 

Some College' 



^Some High School ^rtigh School Graduate 

"B.A. Graduate Work 



Description of Learning Project 



14 Lparnina Goa1(s) (Select one)! 


( Coder will cnmnleiip) 


Fdij rati nna 1 rredi t 


Mppf npnnlp with rnmmnn ^n'^prp<:tc 


Job advancement or change 


Contribute to community 


Increase knowledge • 


Pleasure and recreation 


Increase skill 




Elaborate goal i 



15. Area of Learning Project (Coder will complete with number, e.g. 610., 730, etc.) 



philosophy 
[^Religion . 
"Social Sciences 
"Language 



_Pure Science 

"Technology, Applied Science 
J\rts 

"Li terature 



jGeneral Geography 
and History 



Elaborate Area of Interest: 



16. Background knowledge/skill in learning area: 

No experience Some experience Expert 

Elaborate background: 



17. Learning method preferred by learner: 

Books ^Programmed Instruction 



Audio Visual 



Formal Classes 



Informal Discussions 
"other 



Elaborate Learning Method :_ 



18. Learning location preferred by learner: 
In Library At Home 

^In Classroom Other (specify) 

19. Possible ways of helping the learner meet learning goal(s): 



20. Recommended sequence of learning project (where to begin and steps to follow): 
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''^ Services Provided 

21* Explaining independent learning ^Helping learner define project scope 

program 

Clarifying learning goals . ^Developing learning sequence 

Elaborate service(s): 



Action Taken 



22* ^Provide materials Gather information ^Provide reading list 

_ _Refer inside library ^Provide study quide 

Refer outside library ^Other (specify) 



•'dborate action 



Steps to be taken before next appointment 



Next appointment date 
Comments 



Learner's Advisor 



ERIC 



The purpose of this form Is to provide a record for the learner and the advisor of 
the learner's progress. This form should be filled out by the advisor* 



PROGRESS REPORT 



Contact: Phone Date: 

In Person Time: Begun: 

Learner *_j 



MODIFICATIONS IN LEARNING PROJECT 

1. Changes and/or elaborations in learning goals: 



2. Changes in scope of area of interest: Broader Narrower 

3* Elaborations of changes in area of interest: 



4. Changes in ways of helping learner meet goals: 



5- Changes, elaborations in sequence of learning project: 



LD, NO, 

En d 
Visit No, 



SERVICES PROVIDED ^ 

6. Explaining independent learning program ^Defining scope 

^Clarifying learning goals ^Developing learning sequence 

?• Elaborate service{s): 



ACTION TAKEN 

84 ^Provide materials Provide study guide ^Provide reading list 

Refer outsfde library ^Refer inside library Gather information 

Other (specify) 

9* Elaborate action 



10* Steps to be taken before next appointment 



O "1* Next appointment 
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25 Learner^s Advisor_^ 



9a. Did the Learner's Consultant provide you with a study guide? 

Yes No 

9b. If "yes" was this guide of .help in your learning? (Please check s/) 

1. 2. 3. 4. . 5. 



Not Somewhat Viry 

Helpful Helpful Helpful 

10a. Did the Learner's Consultant refer you to another agency for help in your 
learning? 

Yes No 



10b. If "yes" how helpful was this agency to you? (Please check 

1. 2. . 3. 4._;^ 5._; 

Not Somewhat Very 

Helpful Helpful Helpful 

11. Overall how do you feel about the help provided to you by the Learner's 
Advisory Service? (Please check \/) 

1.^ 2. 3.^ 4. 5. 

Not Somewhat Very . 

Satisfied. Satisfied Satisfied \ 

12. Would you use the service again? 

Yes_^ No Don ^ t know 



13. Would you reconimend the service to someone else? . 
Yes ^ No Don *t know 



14. How do you think you have changed as a result of your project and the help 
the library has prov1ded?_ 



I.D. No. Learner's Name^ 

Date 



Project Status 
2 
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The primary purpose of this form is diagnostic. It should help the cirivu.o.- to 
adjust to the needs of the learner. Tliis form should be filled out by Ihe ad- 
visor in conversation with the learner. 



PROGRESS EVALUATION INTERVIEW I.D. f!o. 



Contact: ^Phone Date 

^In, Person 



1. Learner's Name 



2. Status of learning project: 



3. Does the learner feel that the learning project is moving at an adequate pace? 
Yes No Doesn't know 



Elaborate: 



4. Does the learner feel that he/she is progressing toward his/her learning goal4-^. 

Yes No ^Doesn't know 

Elaborate: 



5. Has the advisor been available when needed? Yes No 

If "no" how can this problem be corrected? 



6. Have the library facilities been conducive to the learner's project? 
Yes No NA 



If "no" how can this situation be improved? 



7. Has the advisor provided the needed assistance in learning plan development? 
Yes No ^Doesn't know 



If "no" what should the advisor do? 



ERIC 



This form will provide a record of all materials selected for a learner and the 
learner's evaluation of these materials- This should be filled out by the ad- 
visor. 



•Learner LD-No. 

MATERIALS WORKSHEET 



Date 


Type of Material* 


Materials Description 


Aval lability 


Usefulness 


(Title and Call NoJ 


On Shelf 


Checked Out - 


Reserved 


-J 
-J 


Ordered 


Appropriate 


Too General 


Too Specific 


Too Advanced 


Too Elementary 


Redundant 


Irrelevant 


Too Old 
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* B-Books, F=Filnis, RL-Reading Lists, S-Slides, SG-Study Guides, T-Tapes. 
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LEARNER'S EVALUATION 



1. Was the library open when you needed It? (Please check J) 

1. 2. 3. 4. 5.^ 

Never Open Open Half Always Open 

the Time 

2. In terms of the needs of your learning project how would you rate the 
library's facilities?,. (Please check V.) 

1. 2. . 3. 4. ■ 5. 

Ppor Sometimes Excellent 

Adequate' 

3. Was the.Ltamer's Consultant available when you wanted to talk? (Please check \f) 

1. 2. 3.^ 4. ■ ■ 5.^ 

Never. Available ^ THways 

Half-the Time Available:. 

4. How comfortable were you in talking to the Learner's Consultant about. what^you 
wanted to learn? (Please check ' ■ / . . 

1. • • 2.__ 3.^ 4. , ^, 

"Not - Sometimes , Very 

Comfortable Comfortable Comfortably 

5. How well did you feel the Learner's Consultant unc|erstood what you wanted to 
learn?" (Please cheek y) 

1. 2., 3. .- 4. 5. 

No Some FuTT 

Understanding Understanding Understanding 

6. How helpful Was the.Learfier's Consultant 1n developing a plan for your learning 
(helping you decide how .to be^in and What to do)? - (Please check . i/) 

' * r » f ' ' ■ ; • < 

1. 2., 3. 4. . 5.^ 

Not ' Somewhat:. Very 

Helpful Helpful Helpful 

7. Were the right materials (books,, record?, etc.) available when you needed. them? 
(Please ^check . " " " . .n^.. ^ 

1. 2. 3. 4. , 5. . 

Never TSvaTTable- THway s • 

Available Half -.the Tijne Available-. 

8. How useful were , the materials given to you .by the Learner^s Consultant in helping 
you learn what you, .wanted to learn? (Plea^^ check • v') ' 



Leimer's Consultant Evaluation 

8t. Did you refer the. learner-to another? agency In'the community? 

Yes^ No 

lb. If "yes", how helpful was the agency to.;the learner? (Please, check ^) 

.2.__ .3,,^_^ '4-^;-^ 5. 
Not • Somiwhat, ' Vefy^ 

Helpful. Helpful ■ ' Helpful 

It. Did you. feel .you had enough ,t1me .to work w.lth the learner?. 

Yes.^.^ fjO; ^ 

If "no", please comment,^ . 



10. Were the ficllltles and equipment in the. library sufficient for what-you needed 
to help tl^e" learner? ■ ■ < •. < , , •■ 



Yes . No. 

If "no" J, please C9mment_ 



11. . Overall how satisfied are you with how you helpe<l'\the learner; with -his/her 
learning project? P.lease -check v') 

• % « 

' Not Somewhat Very 

Satisfied. Satisfied Satisfied 

U» Old you see Indications of change in the learner as a. result of his/her projtct? 



Learner':S Consultant 
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o Consgltant'i ,I.D. No; ^'^s 

Dite 



LEARNER'S CONSULTANT EVALUATION 



Learner's Name I.D. No._ 

Status of Project 



1. How comfortable was the learner in talking .with you about what he/she wanted to 
learn? (Please check ^) 

1. 2. 3. 4. 5.^ 

Not Sometimes Very 

Comfortable Comfortable Comfortable 

2. How well did you understand what the learner wanted to learn? (Please check 

1.^ 2. 3,^ 4. 5. 

No Some Ful.l 

Understanding Understanding Understanding 

3. How helpful were you in developing a learning plan? (Please check /) 

1. 2. 3. 4. 5.^ 

Not Somewhat Very 

Helpful Helpful Helpful 

4. Were you available when the learner wanted to talk? (Please check /) 

1. 2. ■ 3..^ 4. ■ 5.^ 

Never Available ^Always 

Available Half the Time Available 

5. Were appropriate materials available for the learner when he/she needed them? 
(Please check >/)' 

1. 2. 3._ 4. 5. 



Never Available Always 

Available Half the Time- Available 

6. How useful were the materials that you provided the. learner in helping 

him/her reach his/her learning goal? (Please check';/) 

1. 2. • 3. 4. 5.^^ 

Not Somewhat Very 

Useful - Useful Useful 

7a. Did you provide the learner with a stucly guide? 

Yes No 

7b. If "yes" was this study guide useful to the learner? 

l.„ 2. 3.^ 4._] 5.^ 

Not Somewhat Very 

Useful Useful ' Useful 



The purpose of this form is to provide information on how much time is spent 
in doing tasks to support a learning project. This information is essential 
for planning the staff levels needed for future service to the adult indepen- 
dent learner. This form is to be filled out by the consultant each time some 
work is done-for the learner. 



TIME RECORD 

Consultant's Name 



Name or Learner Identification No. 



Amount of time spent per function 



Date 












Total 


Discussion between consultant and learner 














Discussion between consultant and other 
^ staff or administration 















Bibliographic, file or agency searches 














Locating or ordering materials 














Background reading and think time 
(planning) 








k 


f 




Evaluating materials 






I 




I 




Reserving materials 














Developing learning aids 














Referral or direction to other than 
librarv <;Qurrp<; or agpnn'pc 


* 













Completing data fonns 














Typing or filing, xeroxing 















EXHIBIT C 
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; V Sv;:v:-.n.'v; Mo.'.n Por'/.oniio 1 Tinu^. por Function 
.V.v.h 0:t:-NTan Yoor 1974-75 



* ■■ ' 

v> ;:•.«.-..• a;."^rr or dvlmini o trot ion 



06 



\ 30 lir ■; 27 min \ ^/A.IC • r;i.?;;^.40 



25 



27 hr ?. 65 min "i $5.1ft •. ^>UO^Co\ 



Coordination with other cJopts | 22 j 16 hr > 44 min j $3.52 1. $76.80; 

\ 31 j 70 hr |j 135 min j $10.83 : $336.0a j 



! Cooro. with ouiuin. 



Vcvtnl: ProvM orronpc, coord. 



I 164 !i 151 hr I 



I S724.Ji0i 



5;bHo{;rnpWic, file, ogcncy 



Locntinc; or orJcring 



29 I 21 hr ii 43 min $3.44 ] $100.80 j 
! 51 I 18 hr 'j 21 min j' $1.68 j $86.40 \ 



Sr.ckground & Think 



26 



18 



jcvolopinv} Icorn. oids 



5vcf. or dir. 'co other sources 
or cjcnciei etc. 



\ 15 hr I 35 min t $2.30 j $72.00 j 
i 17 hr j 5 7 min ! $4.53 ! $81.60 I 

i \ 

I 7 J 2 hr 17 min j $1.37 j $9.50 ^ 
j 21 I 78 hr j 221 min i $17.82 { $374.40 I 



i 1 hr ?, 20 min 



in ) $1.60 \ $4.80 i 



Tozol: ."^cs. dcvcl. & plan. 



155 



152 hr >•* 




process ng Jmc* 'C . 



Copy ir.v3 



2 ? 2 hr ? 60 min 1 $4.80 J $9.60 S 
9 



i {■ ( 5 

3 hr ? 20 min *; $1.60 i $14.40 >; 



Typir.5 or f i 1 ing 



52 21 hr 24 min i $1.94 I ' $100.80 i 



Tot.ii : Clcr icnl 



63 



! 26 hr I 




$124.80 



.•o. .ov/-up 



i 16 j 47 hr 1176 min ( $14.10 1 $225.60;: 



.-. . snrf oval . 



52 i 197 hr 1227 min ? $18.18 ■ $545.60 \ 




Totai: All Functions 



r 450 1 573 hr [ 




■$2750.40 r: 



id 
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EXHIBIT D 
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su.\MAiiY im OF Sim iNDnr-u^n)i:NT s'.{udy and G-JUiAfiO; mmar 

SLQ'L im\ A SLCVL vms w 

October . . . 20 • • .^4^ 

• • • 

Novciiiber 12 ' 1^) 

i>2ccinl)er ^ . 6 ^ n 

Jcuuiary ,1^. ' , 

Total 42 ♦ 46 • 

^/ 

Total of Sessions: 8S 

VcDxx Sossioiis Per Leanicr: 2*09 

lUrngo of Sessions Per Learner: From one (1) to cloycn (11) meotiaigs 

^fcan Tine, Initial Intcivi<w: 23 mnutcs 

Moan Tixye, Progress Sessions: 39 jninutc:v . * 

Range, Initis.1 Interview: From three (3) to ninet)' (90) ininutes \ 

llanse, Progress Sessions: From five (5) to seventy (70) minutes \ 

Totaj. Materials Given to Learners: 183 

Average if Materials for cadi Learner: 4.47 

Total Itesource Guidance Lists for Learners: 12 

Total # of Referrals hkde for Lcan\ers: 18 

To Ed* Inst.: 8 

To Agencies: 3 

To Counselors: 2 

Other: . • ' 5 

Library Learning Evrcnts Schedu3.ed: 13 



or* 



^ CHARflCTERISlTICS 



SEX 



Male 
Feitiale 

Under 18 
19 - 21 
22 - 35 
36 - 54 
55 - 65 
Over 65 

CXrUPATION 
Bus. of Ind. 
Govt, or N.P. 
Self 
Prof. 
Home 
Retired 
Unenployed 
Student 

roUCATION 
0-9 
10 - 12 
Some College 
AB/BA 
Masters + 

ETHNIcmr 
Caucasian 
Negro 
Other 



I 




47.2 
52.7 



36.5 
7.6 
20.1 
10.5 
11.0 
14.3 



33.9 
20.2 
6.0 
21.7 
N/A 
8.2 
3.3 
6.6 



17.4 
48.8 
16.8 
16.9 



96.8 
1.2 
1.9 



49.7 
50.3 



59.1 
4.8 
11.9 
12.7 
6.5 
5.0 



53.0 
16.0 
6.0 
14.0 
N/A 
4.0 
3.0 
5.0 



10.2 
59.2 
16.9 
13.6 



98.8 
0.1 
1.0 



% 


% 




% 


51 


42 




47 


48 


58 




52 


9 


4 




0 


21 


19 




5 


32 


30 




36 


19 


17 




26 


12 


12 




14 


6 


18 


• 


5 


20 


27 




26 


9 


9 




19 


8 


8 




10 


16 


8 




19 


18 


].7 


• 


10 


6 


16 




14 


3 


3 




0 


22 


9 




0 


2 


20 




0 


17 


3R 




■7 


33 


32 




26 


31 


7 




28 


17 


6 




12 


92 


68 




100 


1 


16 




0 


.7 


17 




0 



14/m 



N/R 2 



m/R 26 
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